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Cortical neurons receive barrages of excitatory and inhibitory inputs which are not 
independent, as network structure and synaptic kinetics impose statistical correlations. 
Experiments in vitro and in vivo have demonstrated correlations between inhibitory and 
excitatory synaptic inputs in which inhibition lags behind excitation in cortical neurons. 
This delay arises in feed-forward inhibition (FFI) circuits and ensures that coincident 
excitation and inhibition do not preclude neuronal firing. Conversely, inhibition that is too 
delayed broadens neuronal integration times, thereby diminishing spike-time precision and 
increasing the firing frequency. This led us to hypothesize that the correlation between 
excitatory and inhibitory synaptic inputs modulates the encoding of information of neural 
spike trains. We tested this hypothesis by investigating the effect of such correlations 
on the information rate (IR) of spike trains using the Hodgkin-Huxley model in which 
both synaptic and membrane conductances are stochastic. We investigated two different 
synaptic input regimes: balanced synaptic conductances and balanced currents. Our 
results show that correlations arising from the synaptic kinetics, r, and millisecond 
lags, S, of inhibition relative to excitation strongly affect the IR of spike trains. In the 
regime of balanced synaptic currents, for short time lags (S ~ 1 ms) there is an optimal 
r that maximizes the IR of the postsynaptic spike train. Given the short time scales 
for monosynaptic inhibitory lags and synaptic decay kinetics reported in cortical neurons 
under physiological contexts, we propose that FFI in cortical circuits is poised to maximize 
the rate of information transfer between cortical neurons. Our results also provide a 
possible explanation for how certain drugs and genetic mutations affecting the synaptic 
kinetics can deteriorate information processing in the brain. 



Keywords: stochastic Hodgkin-Huxley model, synaptic kinetics, input correlation, information, feed-forward 
inhibition 



INTRODUCTION 

The rate and timing of firing in cortical neurons is strongly 
affected by the interaction between synaptic excitation and inhi- 
bition (Salinas and Sejnowski, 2000). The architecture of cortical 
circuits ensures that the magnitude of excitatory and inhibitory 
synaptic inputs is approximately balanced on average and tem- 
porally correlated (Shu et al., 2003b; Haider et al., 2006), albeit 
with a small time delay for inhibition of ~1— 10 ms (Wehr and 
Zador, 2003; Okun and Lampl, 2008; Wu et al, 2008). This 
correlation in amplitude and timing presumably arises in feed- 
forward inhibition (FFI) circuits, an anatomical motif present 
ubiquitously throughout the cortex which drives monosynaptic 
excitation and disynaptic inhibition onto target neurons (Porter 
et al, 2001; Sun et al, 2006; Cruikshank et al, 2007). The func- 
tional consequences of the correlations imposed by such a layout 
are far-reaching, encompassing a range of functions such as gain 
modulation for rapidly fluctuating synaptic inputs (Salinas and 
Sejnowski, 2000; Chance et al., 2002; Shu et al, 2003a; PouUle 
et al., 2009), shaping of neuronal tuning properties and stimulus 
selectivity (Wehr and Zador, 2003; Marino et al, 2005; Wu et al., 



2006), directing the propagation of activity by selectively gating 
firing in neuronal ensembles (Kremkow et al., 2010a,b), and cre- 
ating "windows of integration" during which excitatory inputs 
can temporally summate to promote spike generation before 
being rapidly suppressed by inhibition (Pouille and Scanziani, 
2001; Pouille et al., 2009). Furthermore, Marsalek and colleagues 
demonstrated that small differences in the timing between presy- 
naptic excitatory and inhibitory inputs (i.e., input correlation) is 
directly correlated with temporal jitter in postsynaptic spikes, i.e., 
output precision (Marsalek et al., 1997). Since neurons may repre- 
sent information through the precise timing of spikes (decharms 
and Merzenich, 1996; Dan et al., 1998; Strong et al, 1998; Liu 
et al, 2001; Nemenman et al, 2008), it stands to reason that the 
control of spike timing by correlated excitation and inhibition 
is likely to govern the transfer of information between corti- 
cal neurons. Previous investigations using realistic simulations 
of cortical neurons have shown that, indeed, balanced excita- 
tory and inhibitory synaptic currents maximize both coding and 
metabolic efficiency of neuronal spikes (Sengupta et al, 2013). 
In that study, however, the excitatory and inhibitory synaptic 
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conductances were uncorrelated and as a result did not exhibit the 
correlation characteristic of cortical dynamics under experimen- 
tal contexts (Wehr and Zador, 2003; Okun and Lampl, 2008; Wu 
et al., 2008). Furthermore, Kawaguchi and colleagues have shown 
that the relative balance between excitation and inhibition of a 
random synaptic input to simulated pyramidal neurons controls 
the maximal information content of spike trains in the presence 
of background synaptic noise (Kawaguchi et al, 2011), yet the 
timing of excitation and inhibition with respect to each other 
were not considered. To our best knowledge, the relevance of sta- 
tistical correlations between balanced excitatory and inhibitory 
synaptic inputs for the information rates of neural spike trains 
have not been investigated. This may in part be due to the high 
computational cost of realistic simulations of stochastic neu- 
ronal dynamics. Here, we have overcome this limitation by using 
the stochastic-shielding approximation, which was recently intro- 
duced by our lab, accelerating stochastic simulations by up to two 
orders of magnitude while preserving accuracy (Schmandt and 
Galan, 2012). 

A critical factor that influences the correlation between synap- 
tic conductances and their effect on firing of cortical neurons is 
the time-course of the conductance change (Svirskis and Rinzel, 
2000). This time-varying conductance shapes the trajectory of the 
membrane potential toward spike threshold and, consequently, 
alters the probability of firing an action potential. In support 
of this notion, previous findings have shown that the precision 
of spike-timing in pyramidal neurons has an inverse relation- 
ship with the decay kinetics of excitatory postsynaptic currents 
(Rodriguez-Molina et al., 2007), that is, spike time precision 
decrements as the postsynaptic currents slow down. The kinetics 
of postsynaptic synaptic responses may be modified by electro- 
tonic filtering of the inputs across the dendritic arbor (Kleppe and 
Robinson, 1999), activation of distinct afferents (Walker et al., 
2002), changes in the driving force (Salin and Prince, 1996), 
developmental changes in postsynaptic receptor (or receptor sub- 
unit) expression (Kirson and Yaari, 1996; Cohen et al., 2000; 
Bannister et al, 2005), interaction with intrinsic conductances 
(Miller et al., 1985; Wilson, 1995), and the presence of receptor- 
specific drugs (Orser et al., 1994; Poncer et al, 1996; Cohen et al., 
2000). To our knowledge, the relationship between the kinetics of 
synaptic conductances and the information rates of neural spike 
trains has not been investigated. 

In this study, we test the hypothesis that the rate of information 
transfer in cortical neurons depends on the correlation between 
concurrent excitatory and inhibitory synaptic inputs. We predict 
that an optimal time lag (S) between excitation and inhibition 
would maximize information transfer between cortical neurons, 
since lags that are too short would preclude neuronal firing while 
long lags will likely decrease the precision of neuronal firing by 
prolonging the window of integration of presynaptic inputs. This 
prediction is consistent with a previous study showing an optimal 
time scale of rapidly fluctuating inputs for spike time reliability 
(Galan et al., 2008). Extending this hypothesis further, we predict 
that the rate of information transfer will depend on the kinet- 
ics of the synaptic conductance change, which inarguably affects 
the temporal correlation between synaptic excitation and inhi- 
bition (Svirskis and Rinzel, 2000). To test this hypothesis, we 



employ a biologically inspired Hodgkin-Huxley-type simulated 
neuron with stochastic ion channel gating (Schmandt and Galan, 
2012) and drive it with Poisson trains of matched excitatory and 
inhibitory synaptic inputs. We test the impact of relative lag times 
between excitation and inhibition on the information rates of 
our model neuron across a range of lags and decay kinetics of 
synaptic conductances. Moreover, we compare the dependency 
of the information rates on the lags and kinetics in two synaptic 
regimes of (1) balanced conductances; and (2) balanced currents; 
this distinction is functionally important since the driving force 
can directly control the ratio between excitatory and inhibitory 
synaptic currents. Our findings reveal that the information rate 
(IR) of the neural spike train is indeed dependent on the synaptic 
kinetics as well as the relative delay times between excitation and 
inhibition. We show that the dependence of the IR on the synaptic 
kinetics shows an optimum at short and physiologically relevant 
monosynaptic delay times and that this dependence is present 
in the balanced currents, but not in the balanced conductances 
regime. 

RESULTS 

To investigate the role of temporal and cross-correlations in 
synaptic inputs on information transmission in cortical neurons 
we modeled excitatory and inhibitory synaptic conductances as 
two separate input channels injected into a single-compartment 
conductance-based Hodgkin-Huxley model neuron with stochas- 
tic biophysics. Ion channel stochasticity is essential for this 
model to recreate biologically faithful spike behavior (Fitzhugh, 
1965; Skaugen and Walloe, 1979; Strassberg and Defelice, 1993; 
Schneidman et al., 1998). To carry out this computationally 
expensive task, we applied the stochastic shielding approximation 
(SSA) to ion channel gating, which has been shown to recreate 
the behavior of stochastic Hodgkin-Huxley models using sub- 
stantially less computational power than other approaches while 
preserving accuracy (Schmandt and Galan, 2012). Central to our 
method was our ability to generate trains of synaptic inputs with 
Poisson statistics and precisely controlled temporal and cross- 
correlations. The temporal correlations of the barrages arise from 
the synaptic kinetics whereas cross-correlations are created by 
shifting two identical barrages relative to each other. 

MAGNITUDE, KINETICS, AND CORRELATION OF SYNAPTIC EXCITATION 
AND INHIBITION 

We modeled excitatory and inhibitory conductances as two sep- 
arate channels of Poisson-distributed events whose rate was set 
by the fixed parameter k (5ms _1 ), which is inversely propor- 
tional to the average inter-event interval, and whose kinetics 
were varied across a range of r values (1-10 ms), represent- 
ing the time-constant of the synaptic conductance decay. This 
time constant introduces a temporal correlation (auto-correlation 
time) in the synaptic barrage (see Materials and Methods). 
Excitatory and inhibitory conductance amplitudes were either 
matched (g exc = 3 pS/n-m 2 , gi„h = 3 pS/|im 2 ) to simulate the bal- 
anced conductances regime or the inhibitory conductance was 
multiplied by a factor of 8, which in our model generated 
approximately balanced excitatory and inhibitory synaptic cur- 
rents (g exc = 3 pS/|xm 2 ,g,„j, = 24pS/|xm 2 ) on average. Figure 1A 
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FIGURE 1 | Modeling excitatory and inhibitory synaptic inputs. (A, 

left) Raw traces of identical and balanced excitatory (gexcl red trace) 
and inhibitory ((?,■„/,; blue trace) synaptic conductances. (A, right) Raw 
traces of excitatory and inhibitory synaptic conductances necessary to 
generate approximately balanced postsynaptic currents. Note that the 
vertical scale bars differ in magnitude between (A, left) and (A, right). 
(B) Raw traces of a single synaptic event plotted as the time course 
of the synaptic conductance for different values of x, which 
corresponds to the decay time constant. (C) Cross-correlogram of 
balanced excitatory and inhibitory synaptic conductances shown in (A, 
left) calculated across a range of x values. Colored circles correspond 



to the numerically determined cross-correlation of Poisson synaptic 
input trains, while solid colored lines correspond to the analytically 
derived cross-correlation (see Materials and Methods). Note that the 
width of the cross-correlation function broadens with increasing z. 
(D) Raw traces of identical balanced excitatory and inhibitory synaptic 
conductances offset with respect to each other by 3 = 5 ms. The inset 
shows a feed-forward inhibition circuit configuration that can generate 
such lags between identical trains of excitation and inhibition. The left 
triangle corresponds to the afferent input that activates excitatory 
target neurons (right triangle) monosynaptically and inhibitory 
interneurons (circle) disynaptically. 



represents the raw conductance traces in both the balanced 
conductance (Figure 1A, left) and balanced currents regimes 
(Figure 1A, right). For determining the effect of synaptic kinetics 
on information rates in cortical neurons, we generated synap- 
tic input trains with different decay kinetics. The r value was 
identical for a given pair of excitatory and inhibitory conduc- 
tances, but was varied across different simulations. Figure IB 
depicts a unitary synaptic conductance across a range of X val- 
ues. This value visibly sets the width of the time-varying con- 
ductance without affecting the rise time or the time at peak 
amplitude (Figure IB). To understand how the kinetics shape 
the correlation structure between synaptic inputs, we analyzed 



the cross-correlogram between excitatory and inhibitory synaptic 
conductances as a function of the synaptic kinetics (Figure 1C). 
Clearly, the cross-correlation between excitation and inhibition 
is affected by the kinetics of the synaptic conductances, which 
are identical for both channels. As expected, the cross-correlation 
decays proportionally with the decay of the conductance wave- 
form itself. Indeed, the numerically determined cross-correlation 
of the synaptic input trains (circles) accurately fits the analyt- 
ically derived cross-correlation values (lines), as calculated in 
Materials and Methods. Central to our goal is the ability to 
also manipulate the cross-correlation between synaptic excita- 
tion and inhibition. To this end, we introduce a relative lag, 
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<5, which delays the inhibitory conductance with respect to the 
excitatory. Figure ID shows the raw conductance traces with inhi- 
bition lagging excitation by S = 5 ms. In the context of cortical 
networks, such lagged correlations can arise through the FFI 
circuit (Figure ID; inset schematic). This motif enables disynap- 
tic inhibition generated by local interneurons (black circle) to 
lag behind monosynaptic excitation (black triangle) with delays 
ranging from 1 to 10 ms (Wehr and Zador, 2003; Okun and 
Lampl, 2008; Wu et al., 2008) thus, providing cortical neurons 
with windows of integration whose width is determined by the 
relative lag between excitatory and inhibitory conductances and 
their decay kinetics. 

SPIKING BEHAVIOR OF A STOCHASTIC HODGKIN-HUXLEY NEURON IN 
RESPONSE TO KINETIC ALLY VARIANT SYNAPTIC INPUTS 

The synaptic conductances described in the section above were 
injected into a single compartment Hodgkin-Huxley model of 
a neuronal membrane (100 (Jim 2 ) with stochastic voltage-gated 
Na + and K + conductances, and a deterministic leak conductance. 
When the magnitude of the synaptic conductances was set to zero, 
the neuron fired spontaneously at ~30Hz. This spontaneous 
firing resulted from the stochastic flickering of voltage-gated ion 
channels, as did the subthreshold oscillations of the membrane 
voltage seen during periods of quiescence (Figure 2A; top row). 
Depicted in Figure 2A are also the spike traces of the model 



neuron injected with matched excitatory and inhibitory conduc- 
tances (middle row) and matched currents (bottom row). In both 
regimes, neurons were presented with trains of synaptic events 
with either fast (r = 1 ms; left column) or slow kinetics (r = 
10 ms; right column). In the presence of excitatory and inhibitory 
balanced conductances with fast kinetics, the firing rate increased 
to ~60 Hz (Figure 2A; left column, middle row) and further 
increased to ~80 Hz when the kinetics were slow (Figure 2A; 
right column, middle row). In the synaptic input regime of 
balanced currents, the spike rate increased to ~60 Hz when the 
synaptic kinetics were fast, but dropped to ~30Hz when the 
conductance decay was slow (Figure 2 A; right column, bottom 
row). Thus, the decay time constant of the synaptic conductance 
impacts the firing rate differentially in the presence of balanced 
conductances vs. balanced currents. This becomes apparent when 
the firing rate is determined across the full range of synaptic 
kinetics and lags in both the balanced conductance (Figure 2B) 
and balanced currents (Figure 2C) regimes. Longer decay kinetics 
effectively increase the firing rate when the synaptic conduc- 
tances are balanced and reduce the firing rate when the currents 
are balanced. Moreover, when the synaptic conductances are 
balanced, the firing rate shows no dependence on the lag between 
excitation and inhibition, but when the currents are balanced 
the firing rate is highly sensitive to short lags (0 > S > 3 ms; 
Figure 2C). 




FIGURE 2 I Firing properties of a stochastic Hodgkin-Huxley neuron in 
different input regimes. (A) Raw traces of membrane potential dynamics in 
three different input regimes: top row corresponds to spontaneous firing in the 
absence of synaptic inputs; middle row corresponds to firing in response to 
balanced synaptic conductances; bottom row corresponds to firing in 
response to balanced synaptic currents. The left column represents neuronal 
firing in response to synaptic events with very fast kinetics (z = 1 ms) and the 



right column represents firing in response to synaptic events with slow 
kinetics (t = 10 ms). Note that the offset between excitation and inhibition in 
all traces is set at S = 5 ms. (B) Surface plot of firing rates of the model neuron 
in response to balanced synaptic conductances with varying synaptic kinetics 
(i) and relative lags between excitation and inhibition (<5). (C) Surface plot of 
firing rates of the model neuron in response to balanced synaptic currents with 
varying synaptic kinetics and relative lags between excitation and inhibition. 
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ENTROPY OF NEURAL SPIKE TRAINS 

Information content of a sequence of action potentials is by def- 
inition related to the variability of spike timing in response to 
an input signal. Repeated presentation of the same input con- 
ductance to the model neuron, therefore, enables us to measure 
the reproducibility of the resulting spike pattern. The top panel of 
Figure 3A shows the spike trains as in response to the same input 
conductance across ten trials (frozen input). Applying entropy 
measures as a proxy for spike variability, we obtain the "noise 
entropy" of the response across repeated presentations of the 
input signal. Noise entropy, however, informs us only about the 
spike variability to a single input pattern. To account for the 
full spectrum of potential spike responses of the model neuron, 
we presented a different set of input conductances across trials 
(unfrozen input; Figure 3A, bottom), this time yielding the "total 
entropy" of the spike train. Entropy measurements were car- 
ried out using the "direct method" (see Materials and Methods), 
which involved converting the output signal into a binary string 
of O's and l's by binning the spike trace with small time windows 
(Af = 5 ms) and counting spikes within each bin. A bin con- 
taining no spikes corresponds to a 0, while a bin containing one 
or more spikes corresponds to a 1 (Figure 3B). We then gener- 
ated sequences of words of various lengths (T = Atx number of 
bins) which were then used to calculate the entropy based on the 
probability of occurrence of each possible word. Entropy, being 
an extensive property, scales with the length of the signal being 
measured and is sensitive to the temporal resolution of binning 
(Strong et al, 1998). Thus, to estimate the maximal entropy of 



the spike trains we extrapolated the entropy for words of length 
oo (Figure 3C). Entropies were normalized by time to give 
entropy rates per time unit (bits/s). 

We calculated the entropy rates for sets of paired excitatory and 
inhibitory conductances across a range of time lags for inhibition. 
Figure 3D shows the entropy rates as a function of S for the sam- 
ple traces shown in Figure 3A. These rates are exemplary of only 
a single value of the synaptic kinetics and are presented strictly 
heuristically. Our results show that the total and noise entropies 
are initially very low when excitatory and inhibitory conductances 
occur simultaneously but rise rapidly across a short range of <5 
values until they plateau around 8 = 2 ms. The following sections 
will deal with the use of these entropy rates for the determination 
of spike train information rates. 

INFORMATION RATE OF SPIKE TRAINS IS INSENSITIVE TO SYNAPTIC 
KINETICS AND THE RELATIVE DELAY OF SYNAPTIC INHIBITION IN THE 
BALANCED CONDUCTANCES REGIME 

Measuring the information rates of a neural spike trains requires 
that we take the difference between the total and noise entropy 
rates. This difference quantifies the IR without necessitating 
assumptions about the nature of the signal being represented. We 
applied this measure to spike trains generated across a range of r 
and S values to assess the dependence of the IR on the temporal 
correlation of excitatory and inhibitory synaptic inputs. This was 
first done for the balanced conductances regime. The top panel 
of Figure 4A shows the dependence of the information across a 
range of r and S values. The IR remains high and constant across 
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FIGURE 3 | Entropy of neural spike trains. (A, top) Sample raster plots of 
neuronal firing in response to the presentation of a fixed stimulus (i.e., frozen 
input) across 10 trials. (A, bottom) Raster plots of neuronal firing in response 
to the presentation of different stimuli (i.e., unfrozen input) across 10 trials. 
(B) Schematic showing how spike trains (represented by spike raster) were 
converted to binary strings of O's and 1's by binning the voltage trace into 
time bins of size At = 5 ms. From these strings, words of various lengths 



were generated and the probability of their occurrence was calculated to 
yield entropy rates. (C) Entropy rates for spike responses in response to 
frozen input (noise entropy) and in response to unfrozen input (total entropy) 
calculated across different word durations. The true entropy rates were 
extrapolated by taking the entropy rate in the limit of T— > 00 (or 1/7" —> 0). 
(D) True entropy rates of neural spike trains in response to synaptic inputs 
with different lag times (<5) between excitation and inhibition. 
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FIGURE 4 | Information rates of neural spike trains in the balanced 
conductances regime. (A, top) Surface plot of the information rate of neural 
spike trains as a function of the synaptic kinetics (t) and delays in inhibition 
relative to excitation (<5). (A, bottom left) Information rate as a function of 
synaptic kinetics for three different values of S. This plot corresponds to three 
different slices taken from (A, top). (A, bottom right) Plot of firing rate as a 



function of synaptic kinetics for the same three S values presented in 
(A, bottom left) shows that the dependency of the information rate on the 
synaptic kinetics is not accounted for by similar changes in firing rate. (B) 
Range of information rate as a function of relative delay between excitation 
and inhibition. The red dots correspond to the three values of 8 shown in 
(A, bottom left) and (A, bottom right) (see Results for explanation). 



different values of 8 when the synaptic kinetics are fast (r < 4 ms) 
and increases by no more than 40% with increasing lags when the 
kinetics are slow (r > 5 ms). The bottom left panel of Figure 4A 
shows three slices taken from the surface plot corresponding to 
the IR for three values of 8 as a function of the kinetics. The 
selection of these three points will be clearly explained in the 
next section. Visible from this panel is that for the three differ- 
ent S values, the change in IR follows a similar trajectory: for 
fast kinetics the IR slowly increases until reaching a maximum 
at ~3 ms and then decreases for higher values of x. The relation- 
ship between the IR and r cannot be accounted for by changes 
in firing rate, which increases monotonically with increasing r 
for all values of <5 (Figure 4A, bottom right; Figure 2B). To quan- 
tify the range of information rates of the spike train across the 
full range of synaptic kinetics, we took the difference between the 
maximal and minimal IR values along the r dimension for dif- 
ferent 8 values and saw that the IR range was highest for short 
lags (35 bits/s) and decreased steadily with increasing lags. This 
decrease in the IR range of the spike train corresponds to the 
flattening of the IR curve across the r dimension with increasing 
values of S. 



INFORMATION RATE OF SPIKE TRAINS EXHIBITS DEPENDENCE ON 
SYNAPTIC KINETICS AT SHORT DELAYS FOR INHIBITION IN THE 
BALANCED CURRENTS REGIME 

We next determined how the IR changes with r and S in the bal- 
anced synaptic currents regime. The surface plot in top panel 
of Figure 5A shows an entirely different dependency of the IR 
on synaptic kinetics and relative lags times. For 8 > 2 ms, the 
IR remains high and relatively constant across different values 
of r; however, as the synaptic lags decrease below 2 ms, the IR 
begins to show an optimal dependence to the synaptic kinetics. 
The bottom left panel of Figure 5A shows the IR as a function 
of r for three values of 8. These results show that for instan- 
taneous lags (8 = 0 ms) the IR is relatively low (IR < 20 bits/s) 
and decreases slowly across the r dimension; for 8 = 4 ms, the 
IR does not undergo dramatic changes and remains relatively 
high (IR > 95 bits/s); for 8 = 0.8 ms, however, the IR begins at 
an intermediate value (70 bits/s) and increases until it reaches 
an optimum at x = 4 ms, then drops 55% relative to the max- 
imal value (Figure 5 A, bottom left). Again, this dependency of 
the IR on the kinetics cannot be explained by changes in firing 
rate which decrease approximately monotonically with increasing 
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FIGURE 5 | Information rates of neural spike trains in the balanced 
currents regime. (A, top) Surface plot of the information rate of 
neural spike trains as a function of the synaptic kinetics (i) and 
delays in inhibition relative to excitation (<5). (A, bottom left) 
Information rate as a function of synaptic kinetics for three different 
values of S. This plot corresponds to three different slices taken from 
(A, top). (A, bottom right) Plot of firing rate as a function of synaptic 
kinetics for the same three S values presented in (A, bottom left) 



shows that the dependency of the information rate on the synaptic 
kinetics is not accounted for by similar changes in firing rate. (B) 
Range of information rate as a function of relative delay between 
excitation and inhibition. The red dots correspond to the three values 
of S shown in (A, bottom left) and (A, bottom left). Note the three 
points circled in red correspond to the peak IR range values and two 
non-adjacent S that do not exhibit the optimum in information rate as 
a function of kinetics. 



r values (Figure 5A, bottom right). Applying the same anal- 
ysis used in the previous section, we compute the IR range 
across the x dimension for different values of S and observe 
that the IR exhibits the most dramatic dependence of synap- 
tic kinetics at an optimal value of the relative lag (<5 = 0.8 ms). 
Thus, the selection of the three S values shown in the bottom 
panels of Figures 4A, 5A and circled in red in Figures 4B, 5B 
are based on the range of S values within which the optimum 
occurs (<5 = 0 ms: S = 4 ms) and the S value at the optimum 
(S = 0.8 ms). This optimal dependence of the IR on synaptic 
kinetics is only present when the synaptic currents are balanced, 
but not the synaptic conductances (Figures 4B, 5B). Incidentally, 
when the synaptic input trains are normalized by the integral 
of their conductance, the IR decreases slowly and monotonically 
with r in the balanced conductance regime and the observed 
peak of the IR as a function of r disappears in the balanced 
currents regime (data not shown). This normalization, how- 
ever, is not physiologically relevant considering that changes 
in synaptic kinetics in biological neurons are not compensated 
for by changes in the amplitude of the synaptic inputs on an 
event-by-event basis. 



DISCUSSION 

In this study we set out to investigate how the encoding of infor- 
mation in neurons depends on the temporal and cross-correlation 
of balanced synaptic inputs. We manipulated the correlation 
between identical trains of excitatory and inhibitory inputs by 
directly controlling the decay kinetics (r) of the synaptic con- 
ductance and/or the relative time delay between excitation and 
inhibition (S), with inhibition always lagging behind. Our results 
show that the encoding of information in neural spike trains 
exhibits a dependence on the correlation between balanced exci- 
tatory and inhibitory synaptic currents and that this dependence 
is absent in the input regime of balanced synaptic conductances. 
Specifically, findings reported herein demonstrate that the synap- 
tic kinetics modulate the IR range at which the spike train 
maximally encodes information, but do so only when synaptic 
inhibition lags behind excitation with very short monosynaptic 
delays (S < 2 ms). Furthermore, our model exhibits an optimal 
delay (8 = 0.8 ms) for inhibition at which the modulation of 
the IR by the synaptic kinetics is highest. Such delays between 
excitation and inhibition are within the physiological range of 
monosynaptic lags obtained from in vitro and in vivo recordings 
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of synaptic barrages in cortical neurons (Wehr and Zador, 2003; 
Okun and Lampl, 2008; Wu et al., 2008). The optimum of the 
IR as a function of r emerges as the result of the following: As 
stated in the Materials and Methods, the IR is determined as a 
difference between the total and noise entropies which represent 
the variability of the spike patterns in response to unfrozen and 
frozen input trains, respectively. Intuitively and empirically, the 
total entropy is substantially larger across different values of x 
and S and changes most drastically at values of S < 2 ms (data 
not shown), at which the neuronal spiking is subject to a dra- 
matic modulation by the inhibitory inputs. It is at this exact 
range of S that the noise entropy is the highest across the r (for 
r < 5 ms) and S dimensions. Why is the noise entropy high- 
est when synaptic kinetics are fast? To answer this question we 
consider the relationship between synaptic input-driven spiking 
and spontaneous firing from stochastic fluctuations of intrinsic 
regenerative conductances. During synaptic bombardment, the 
synaptic conductance is the dominant driver of neuronal firing 
as it overwhelms the intrinsic conductances in both magnitude 
and duration. However, with increasing synaptic kinetics (smaller 
t), the integral of the synaptic conductance decreases and the 
dominance of the synaptic conductance abates, so that stochastic 
fluctuations of the intrinsic conductances allow for spontaneous 
firing. As a result, the spike patterns become more variable, 
thereby increasing the noise entropy. Thus, the peak of the IR 
emerges as a result of this increase in the noise entropy at small 
values of r and S and endows the neuronal membrane with the 
observed dependence of the IR on synaptic kinetics. These results 
are consistent with a previous report showing that spike-time reli- 
ability, an analytic measure related to the information capacity of 
a spike train, shows an optimal value at specific auto-correlation 
times of their uncorrelated synaptic inputs (Galan et al., 2008). 
Therefore, we conclude that synaptic kinetics as well as relative 
delays between synaptic excitation and inhibition may be tuned 
to optimize information transfer between neurons. 

The time-course of the postsynaptic response may be subject 
to modulation by various factors including electrotonic distance 
of inputs from sites of integration (Kleppe and Robinson, 1999), 
pattern of afferent activation (Walker et al., 2002), driving force 
(Salin and Prince, 1996), postsynaptic receptor (and subunit) 
type (Kirson and Yaari, 1996; Cohen et al, 2000; Bannister et al., 
2005), intrinsic conductances (Miller et al., 1985; Wilson, 1995), 
and the presence of receptor-specific drugs (Orser et al, 1994; 
Poncer et al, 1996; Cohen et al., 2000). The many ways in which 
the kinetics of the postsynaptic response to incoming inputs can 
be altered provides cortical neurons with a myriad of mechanisms 
to tune the correlation structure of incoming synaptic inputs. In 
particular, drugs, neuromodulators, etc. may change the synaptic 
kinetics to the point that the IR is outside its range, thereby dete- 
riorating the processing of information in the brain and altering 
the state of awareness and consciousness. 

We have shown here that the IR is also sensitive to the arrival 
times of inhibition with respect to excitation. Precisely controlling 
monosynaptic delay times for inhibition may be less trivial than 
tuning the synaptic kinetics, but is still possible. In the context 
of a feed-forward inhibitory circuit, one potential mechanism to 
tune inhibitory lags may be to alter the integration times of the 



feed-forward interneuron. Experiments in rats have shown that 
integration time in layer 4 stellate cells of somatosensory cortex is 
tightly regulated by thalamocortical FFI, thus controlling the pre- 
cise spike timing of those neurons (Cabernet et al., 2005). Cortical 
interneurons also receive reciprocal inhibition (Lee et al., 2013; 
Pfeffer et al., 2013; Pi et al., 2013) and, as a consequence, are 
likely to have their integration windows regulated by inhibitory 
circuits. The size of the integration window of the feed-forward 
interneuron would control its precise spike timing and resultantly 
the lag of the inhibition in the excitatory neuron. Another way in 
which delays in inhibition can be modulated in a feed-forward 
circuit is through recruitment of distinct inhibitory networks 
(Beierlein et al., 2003). These networks are comprised of molec- 
ularly and physiologically distinct interneuron populations that 
exhibit differential responsiveness to temporally patterned inputs 
and distinct synaptic dynamics. 

Pivotal to the simulations carried out in this study was our 
ability to efficiently simulate the spike behavior of the model neu- 
ron across numerous trials (sampling rate = 10 KHz; 5 s/trial; 
56 trials for each S and t; which yields ~2.2 Gigabytes per data 
point in Figures 4A, 5A). Stochastic simulations of ion channels 
are notoriously expensive computationally and often create the 
bottleneck for generating sufficient data across a large enough 
parameter range. We used the SSA for simulating stochastic 
ion channel gating dynamics (Schmandt and Galan, 2012) to 
avoid this problem. The SSA reduces the number of ion channel 
states requiring stochastic simulation, and therefore, dramatically 
reduces the computational load. 

Modeling of the synaptic inputs required that several assump- 
tions be made about the nature of cortical excitation and inhi- 
bition. First, the model assumes that excitatory and inhibitory 
synaptic inputs are correlated. This assumption has been vali- 
dated by in vitro (Graupner and Reyes, 2013) and in vivo (Wehr 
and Zador, 2003; Okun and Lampl, 2008; Wu et al, 2008) record- 
ings of synaptic barrages from cortical neurons showing that, 
indeed, excitation and inhibition are correlated in magnitude 
and timing, with inhibition tracking excitation by a few millisec- 
onds. Secondly, the rate of synaptic events in time was assumed 
to be fast (5 ms inter-event interval), corresponding to high lev- 
els of correlated activity in presynaptic neurons. Recordings from 
cortical neurons in awake behaving mice during sensory stimula- 
tion (Crochet and Petersen, 2006), in anaesthetized ferrets during 
spontaneous active states (Haider et al, 2006), and in sponta- 
neous active cortical slices (Compte et al, 2008) have confirmed 
high rates of synaptic bombardment, therefore, lending valida- 
tion to the use of high rates of synaptic activity in our model. It 
is important to note, however, that synaptic inputs onto cortical 
neurons have also been shown to occur as sparse and synchronous 
population events (Wehr and Zador, 2003; DeWeese and Zador, 
2006). Our study focused exclusively on synaptic regimes with 
high levels of activity, thus, it will be important to understand 
how temporal correlations between excitation and inhibition in 
sparse regimes affect information encoding. Previous findings by 
Miura et al. suggest that balanced excitation and inhibition in cor- 
tical neurons may in fact decouple irregularity of the spike train 
from rate modulations in firing, which may arise from changes in 
the synaptic input rate (Miura et al, 2007). Thus, the IR of the 
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spike trains, being dependent on irregularity of the spike times, 
may be insensitive to changes in synaptic input rate if excitation 
and inhibition are balanced. On a related note, the magnitude of 
synaptic inhibition has been shown to have an inverse relation- 
ship with the overall rate of synaptic activity (Taub et al, 2013). 
This dependence shifts the relative balance between excitation and 
inhibition and may have a profound effect on encoding of infor- 
mation in cortical neurons. Future studies will need to address 
this problem to better understand the role of synaptic dynamics 
in neural coding. 

The bulk of our study focused on the role of balanced synaptic 
inputs in encoding of information. A previous study by Sengupta 
and colleagues demonstrated that uncorrelated and balanced 
synaptic currents maximize the coding and metabolic efficiency 
of neuronal spikes by reducing the spike rate without substan- 
tially affecting the information rates (Sengupta et al., 2013). Our 
work applies the information theoretic approach using a simi- 
lar model of a stochastic Hodgkin-Huxley neuron to address a 
different question: Are the correlations between synaptic inputs 
relevant for information processing? Our results indeed show a 
dependency of information encoding on the correlation between 
balanced synaptic currents. Moreover, the dependence of the 
information rates on the synaptic kinetics cannot be accounted 
for by changes in firing rate. Though balanced synaptic currents 
effectively decrease the firing rate as the kinetics slow down, this 
relationship is monotonic and does not exhibit the optimum 
dependence to the kinetics seen for the IR. 

Using a conductance-based single-compartment Hodgkin- 
Huxley model offers insight into the interaction between synaptic 
inputs and an active neuronal membrane, but it ignores the com- 
plex shape and electrotonic geometry of cortical neurons. These 
features are important for spatiotemporal integration of synaptic 
inputs (Bernander et al, 1991) since distal dendritic inputs may 
be processed differently due to interactions with active dendritic 
conductances (Miller et al., 1985), differences in electrotonic 
properties (Kleppe and Robinson, 1999) or longer integration 
times caused by differences in FFI (Pouille and Scanziani, 2001; 
Pouille et al., 2009). Future studies should consider the complex 
geometry of cortical neurons and how it may impact information 
processing. 

An important aspect of the work presented herein is its focus 
on information encoding at the level of individual neurons. 
Though single cells certainly have the capacity to encode and 
represent information (Nemenman et al., 2008), distributed net- 
works of anatomically and functionally connected neurons (i.e., 
neural ensembles) also carry out this task (Nicolelis et al., 1995; 
Rothschild et al, 2010; Ince et al, 2013). The role of balanced 
synaptic inputs on information transfer in cortical networks has 
been addressed in previous studies. For instance, using multi-site 
recordings of local field potentials (LFP) in rats and monkeys, 
Shew et al. showed that cortical networks with balanced excita- 
tion and inhibition maximize information capacity and transfer 
(Shew et al., 2011). Our results are in agreement with these find- 
ings, showing optimal information rates of neural spike trains 
when synaptic currents are balanced. It is important to note, how- 
ever, that LFP recordings of cortical networks capture coordinated 
activity of large ensembles of neurons operating at substantially 
slower time-scales than that of single neurons. Thus, the nature 



of the computations performed and information encoded at the 
level of single cells vs. that of neural ensembles is likely to have 
marginal correspondence. 

In conclusion, we provide a biologically realistic model of 
neurons with stochastic ion channel biophysics and synaptic 
inputs and apply information theoretic approaches to show that 
information rates of neural spike trains is dependent on the tem- 
poral correlation of balanced synaptic currents. Our findings 
emphasize the importance of these correlations for information 
encoding and suggest that cortical neurons may optimize this pro- 
cess through precise tuning of synaptic kinetics and timing of 
excitatory and inhibitory inputs. 

MATERIALS AND METHODS 
SYNAPTIC INPUTS 

All simulations were carried out using the Matlab R2013b soft- 
ware package (Mathworks). We modeled the synaptic events as 
Poisson trains with a rate of X = 5 ms~ 1 , which was fixed across 
all simulations. The synaptic train was then convolved with an 
"alpha function" to yield the time-dependent conductance, g(f), 
of the following form, 

g(t) = G(e- t ^-e- t ^) (1) 

where the constant G is set at 300 pS for all simulations tri- 
als in the balanced conductances regime, e is the base of the 
natural logarithm, and r r and r are the rise and decay time- 
constants, respectively. r r is set at a fixed value of 0.2 ms while 
x is varied across the range of 1 < r < 10 ms. The excitatory 
and inhibitory synaptic conductances (g exc and g ln h, respectively) 
were created as identical realizations of a Poisson process in the 
balanced conductances input regime. For the balanced currents 
input regime, the inhibitory conductance was multiplied by a fac- 
tor of 8, yielding a maximal conductance amplitude of 2400 pS. 
To generate conductance traces in which inhibition lagged behind 
excitation, we offset the two waveforms by a lag time, S, 
which for a given simulation was taken from a range of lags, 
(1 < 5 < 10ms). 

ANALYTICAL EXPRESSION FOR THE CROSS-CORRELOGRAM OF THE 
SYNAPTIC INPUTS 

To calculate an analytical expression for the cross-correlogram of 
the excitatory and inhibitory synaptic inputs, we first note that the 
inhibitory input is identical with the excitatory input but delayed 
with a lag, S, so that the cross-correlogram C(S) is actually equiv- 
alent to the auto-correlogram of the excitatory input. We also 
note that the excitatory input is the convolution of a Poisson 
process with the kinetics of a single synaptic event given by (1) 
and recall the following two theorems of time-series analysis: 1) 
The Wiener- Khinchin theorem, stating that for a given signal the 
auto-correlogram is the Fourier transform of its power spectrum; 
and 2) the convolution theorem, stating that the power spectrum 
of the convolution of two signals is the product of their power 
spectra. Therefore, since the power spectrum of a Poisson pro- 
cess is a constant, the cross-correlogram is determined by the 
Fourier transform of the power spectrum of a single synaptic 
event. Defining a = l/r r and /3 = 1/r, the power spectrum of 
a single synaptic event is given by: 
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where k is a constant and | . . . | 2 denotes the square of the modulus 
of a complex number. The un-normalized cross-correlogram of 
the excitatory and inhibitory inputs is then given by the Fourier 
transform of (2) 
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To solve the integral in (3) we apply the residues theorem to a 
closed integration path containing two poles on the upper-half of 
the complex plane, co = ia, iB, whose respective residues are 
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Thus, expression (3) yields 
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Finally, the cross-correlogram, normalized so that C (0) = 1 reads 
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This analytical expression accurately describes the cross- 
correlogram obtained from the numerical simulations, as shown 
in Figure 1C. 

SINGLE COMPARTMENT MODEL 

Neuronal dynamics were simulated in a single compartment 
model of a Hodgkin-Huxley (Hodgkin and Huxley, 1952) neuron 
with stochastic voltage-gated fast Na + , delayed rectifier voltage- 
gated K + channels, and a deterministic leak conductance as 
detailed in (Schmandt and Galan, 2012). Modeling of stochas- 
tic ion channel gating was made more computationally efficient 
by applying the SSA of Markov chains, which reduces observable 
states (Schmandt and Galan, 2012). The fluctuations in the mem- 
brane voltage were described by the following current balance 
equation: 



dictate the extent to which synaptic currents affect the membrane 
potential fluctuations. The membrane potential was simulated 
with a time resolution of dt = 0.01 ms. 

DETERMINATION OF INFORMATION RATES 

Spike train entropy was determined using the "direct method" 
(Nemenman et al., 2008). This approach quantifies the entropy 
of the spike trains without making assumptions about the nature 
of the stimulus. Spike trains were binned in small time win- 
dows (At = 5 ms) and spikes were counted for each bin. A 
value of 0 was assigned to each bin containing no spikes and a 
value of 1 for those containing one spike. With the maximal fir- 
ing rate of the model peaking at 80 Hz (inter-spike interval = 
12.5 ms), our choice of At ensures that at most one spike can 
occur within a given time bin, therefore, providing information 
rates for timing of action potentials with millisecond precision. 
The resultant binary strings of 0's and l's were used to gener- 
ate words of length n where n = 2, 4, 6, 8, 10, yielding words 
that spanned time windows of T = nAt. Probability distribu- 
tions were then generated to quantify the occurrence probabil- 
ity of a given word, P(W), within a response pattern. Noise 
entropy, which measures the reproducibility of spike trains in 
response a fixed input stimulus across trials (56 trials), was 
measured as with respect to the conditional probability of a 
word occurring at time t and calculated with the following 
equation: 



£(W|f)logjP(W|f) 



vv 



where the operator (. . .) ( denotes averaging over time. The total 
entropy, which quantifies the possible permutations of output 
patterns with respect to a broad set of inputs, was determined 
by presenting the model neuron with a different input pattern 
across 56 trials and measuring the occurrence probability of a 
given word. The total entropy was calculated as: 

Hf 0t «/ = -^>(W)log 2 iW 

w 

By definition, the information encoded by the spike train is 
the difference between the total and noise entropies. We thus 
computed the information as: 



H, 



total ' 



(4) 



dv ■ 

C m — = gNa(t) (E Na - V(t)) + g K (t) (E K - V(t)) + gi eak (E leak -V) + 
at 

+ gexcW (E exc - V(t)) +g mh (t) (E mh - VW 
synaptic currents 

where C m corresponds to the membrane capacitance, g^ a , gK, and 
gleak are the Na + , K + , and leak conductances with their respec- 
tive reversal potentials, E^ a , Eg, and E\ ea k- The excitatory and 
inhibitory synaptic conductances (g exc and g,„/, ) along with their 
respective reversal potentials, E exc (OmV) and Ei n h (— 80mV), 



Both the noise and the total entropies were normalized by T to 
yield entropy rates (bits/s). Since entropy is sensitive to the word 
length, we extrapolated the entropy rates in the limit of T oo, 
yielding the true rates, and using (4) the IR. 
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